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(g) There is disclosed an image, editing method and 
apparatus wherein low resolution image data among 
hierarchically encoded image data are decoded, the 
decoded low resolution image data are subjected to 
editing processing, editing data representative of the 
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editing processing are stored, the hierarchically en- 
coded image data are decoded to obtain original 
image data, and the decoded original image data are 
subjected to the editing processing in accordance 
with the stored editing data. 
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© There is disclosed an image editing method and 
apparatus wherein low resolution image data among 
hierarchically encoded image data are decoded, the 
decoded low resolution image data are subjected to 
editing processing, editing data representative of the 

FIG. 1 



editing processing are stored, the hierarchically en- 
coded image data are decoded to obtain original 
image data, and the decoded original image data are 
subjected to the editing processing in accordance 
with the stored editing data. 
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Method of and Apparatus tor Editing Images 



BACKGROUND OF THE INVENTION 



Field of the Invention 

5 

The present invention relates to an image ed- 
iting method and apparatus using hierarchic im- 
ages. 

to 

Related Background Art 

In a conventional method of editing a plurality 
of images stored in an image data base which 
stores data sequentially, the necessary images are is 
read from the data base and written in frame 
memories. The images are processed on the frame 
memories for the enlargement, reduction rotation, 
layout or other processes, and thereafter they are 
combined together and written in another frame 20 
memory. 

With the conventional method, original images 
themselves are used in editing. As the image data 
quantity .and size become large, it takes an unprac- 
tically long time to edit images. A long editing time 25 
causes a slow response to an instruction from an 
operator so that the operator may sometimes lose 
patience. Images to be edited are first searched 
from a plurality of page data stored in the image 
data base and then transmitted. In this case it is 30 
required to display and transmit the whole image 
data in order to see and check it. thereby posing a 
problem of a long search and transmission time. 

SUMMARY OF THE INVENTION 

The present invention has been made in con- 
sideration of the above problems. It is an object of 
the present invention to provide an efficient image *o 
editing method and apparatus. 

It is another object of the present invention to 
provide a high speed image editing method and 
apparatus. 

It is a further object of the present invention to 45 
provide an image editing method and apparatus 
capable of readily obtaining the processing results 
in response to an instruction from an operator even 
for complicated editing processing. 

The above and other objects and advantages so 
of this invention will become apparent from the 
following detailed description when read in connec- 
tion with the accompanying drawings. 



BRIEF DESCRIPTION OF THE DRAWINGS 

Fig. 1 is a block diagram showing an em- 
bodiment of this invention; 

Fig. 2 is a block diagram of an encoder; 

Fig. 3 is a block diagram of a decoder; 

Fig. 4 shows an example of editing; 

Fig. 5 shows an example of an image stored 
in frame memories 6 and 7; 

Fig. 6 illustrates the image cut-out and syn- 
thesis; 

Fig. 7 shows the format of data in a history 
memory; and 

Fig. 8 is a flow chart illustrating the editing 
operation. 

DETAILED DESCRIPTION OF THE EMBODIMENT 

Fig. 1 is a block diagram showing an embodi- 
ment of an image editing apparatus of this inven- 
tion. In Fig. 1, reference numeral 1 represents a 
control unit (CPU) for controlling the operation of 
the entirely of the image editing apparatus, 2 a 
keyboard from which an operator enters various 
commands for editing images, 3 a display unit for 
displaying images and characters, 4 a reader for 
photoelectrical^ reading an original image and 
supplying the image data to the apparatus, 5 a data 
base constructed of a magnetooptical disc or the 
like capable of storing a plurality of image data 
pages, 6, 7 and 8 a frame memory constructed of 
a semiconductor memory or the like capable of 
storing at least one image data page or frame, 9 an 
encoder for encoding image data, 10 a decoder for 
decoding encoded image data, and 1 1 a history 
memory for storing editing procedure data. 

The description will be given below for the 
case where images are read with the reader 4 and 
stored in the data base, a plurality of image data 
(in the description, two pages) are read from the 
data base and synthesized together, and the syn- 
thesized image data are stored in the data base 5. 

A plurality of original image data inputted by 
the reader 4 are hierarchically encoded by the 
encoder 9. The encoded data are sequentially 
stored in the data base 5 in the order starting from 
the low resolution encoded data. Next, in accor- 
dance with an instruction by an operator from the 
keyboard 2, two images to be. synthesized are 
searched from a plurality of images stored in the 
data base 5. The lower resolution encoded data 
(first stage images) of the two searched image data 
are first read and decoded by the decoder 10. The 
decoded low resolution image data of two pages 
are stored in the frame memories 6 and 7 cor* 
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respond to the reduced images of two pages to be 
synthesized. While monitoring the image data in 
the frame memories 6 and 7 displayed on the 
display unit 3. an operator enters an editing com- 
mand from the keyboard 2 to conduct synthesizing 
processing, the editing procedure data of this pro- 
cessing being stored in the history memory 1 1. 

After completion of the editing processing by 
using the reduced images, the encoded image data 
of two pages for all hierarchic stages are read from 
the data base 5 and decoded by the decoder 10 to 
form the original images. The original images are 
stored in the frame memories 6 and 7. Then, under 
control of CPU 1 . the original images are edited in 
accordance with the editing procedure data stored 
in the history memory 1 1 . The edited results are 
stored in the frame memory 8. The edited image 
data stored in the history memory 8 are hierarchi- 
cally encoded by the encoder 9 and stored in the 
data base 5 in the order starting from the lower 
resolution encoded data. 

As described above, an operator instructs to 
edit images by using hierarchically encoded data 
of lower resolution stored in the data base 5. there- 
by allowing high speed editing. In addition, the 
image data of low resolution are used in searching 
image data, thereby allowing high speed search. 

Fig. 2 is a block diagram showing the structure 
of the encoder 9 which is constructed of frame 
memories 12, 14 and 16. reduction circuits 13 and 
15. and encoder units 17. 18 and 19. Original 
image data outputted from the reader 4 or frame 
memory 8 to be hierarchically encoded are stored 
in the frame memory 12. The original image data 
stored in the frame memory 12 are reduced by 1/2 
both in the vertical and horizontal directions by the 
reduction circuit- 13. The reduced image data are 
stored in the frame memory 14. Reducing the size 
may be performed by sampling the image at a 
sampling rate of 1/n (in this case, n = 2) both in 
the vertical and horizontal directions, or by filtering 
the image using a low-pass filter, high pass filter, 
or recursive filter, subjecting the obtained value to 
a threshold processing, and thereafter sampling it. 
Any other reducing method may be used instead. 
The 1/2 size image data stored in the frame mem- 
ory 14 are further reduced by 1/2 both in the 
vertical and horizontal directions and stored in the 
frame memory 16. Therefore, the image stored in 
the frame memory 16 is the original image reduced 
by 1/4 in both the vertical and horizontal directions 
stored in the frame memory 12. 

The image data stored in the frame memory 1 6 
are subjected to an entropy encoding at the en- 
coder unit 17 by means of an arithmetic encoding 
method, to thereby output encoded data 101 of the 
first stage. While referring to the image stored in 
the frame memory 16. the encoder unit 18 causes 



the image data stored in the frame memory 14 to 
be subjected to the entropy encoding, to thereby 
output encoded data 102 of the second stage. 
Similarly, while referring to the image data stored 

s in the frame memory 14, the encoder unit 19 
causes the image data stored in the frame memory 
12 to be subjected to the entropy encoding, to 
thereby output encoded data 103 of the third stage. 
The image data hierarchically encoded as above 

w ate sequentially stored in the data base 5 in the 
order starting from the lower resolution encoded 
image data. 

Although the above embodiment uses as the 
encoding method the entropy encoding, other 
is methods may also be used. Further, the hierarchi- 
cally encoded image data to be stored in the data 
base 5 may be transmitted to another system via a 
communication line. 

Fig. 3 is a block diagram showing the structure 
20 of the decoder which is constructed of decoder 
units 20, 21 and 22, and frame memories 23. 24 
and 25. Encoded data 201 of the first stage (lower 
resolution) among the hierarchically encoded data 
stored in the data base 5 are inputted to the 
25 decoder unit 20 and decoded. The decoded results 
are stored in the frame memory 23 to thereby 
output decoded image data 301 of the first stage. 
In order to produce a reduced image to be used for 
the editing processing in response to an instruction 
30 from an operator, the decoding processing is stop- 
ped at this stage and the image data 301 are 
stored in the frame memories 6 and 7. Also in 
performing the image search, the image data 301 
of the first stage are used. 
35 The following processes are carried out there- 

after in order to reproduce an original image. En- 
coded data 202 of the second stage among the 
hierarchically encoded data read from the data 
base 5 are inputted to the decoder unit 21. While 
40 referring to the image data stored at the first stage 
operation in the frame memory 23. the decoder 
unit 21 decodes the encoded data 202. The de- 
coded results are stored in the frame memory 24 
to thereby output decoded image data 302 of the 
45 second stage. Encoded data 203 of the third stage 
among the hierarchically encoded data read from 
the data base 5 are inputted to the decoder unit 22. 
While referring to the image data stored in the 
frame memory 24, the decoder unit 22 decodes 
so the encoded data 203. The decoded results are 
stored in the frame memory 25 to thereby output 
image data 303 of the third stage. The image data 
thus stored in the frame memory 25 correspond to 
the original image prior to encoding. The image 
55 data 303 read from the frame memory 25 are also 
used by CPU 1 for the real editing processing after 
the editing processing by an operator using re- 
duced images. 
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As the reduced images for use with the editing 
processing, the hierarchic images of the first stage 
have been used in the above embodiment. Images 
of other stages may also be used. Further, in the 
above embodiment, although a hierarchic image 
having three stages has been used, an image hav- 
ing any number of stages may also be used. 

As described above, by encoding and decod- 
ing hierarchically and using low resolution hierar- 
chic image data, high speed editing processing can 
be attained. Further, by using low resolution image 
data, high image search can be attained. Further- 
more, by decoding hierarchic image data of higher 
resolution, an original image can be efficiently re- 
produced. 

Figs. 4 to 8 illustrate examples of an editing 
method. The description will be given below in 
connection with the flow chart shown in Fig. 8 for 
the case where as shown in Fig. 4 desired portions 
of two original images (1) and (2) are cut out and 
synthesized to an image (3). 

Encoded data of two images of the first stage 
read (802) from the data base 5 in response to an 
instruction (801) from the keyboard 2 are decoded 
by. the decoder 10 and stored in the frame memo- 
ries 6 and 7 (803). These operations are illustrated 
in Fig. 5 (1) and (2). Namely, the original image 
reduced by 1/4 in both the vertical and horizontal 
directions is stored as the reduced image in the 
frame memories 6 and 7. CPU 1 causes the image 
data stored in the frame memories 6 and 7 to be 
written in an internal memory 26 and displayed on 
the display unit 3 (804). to thereafter perform an 
editing processing in accordance with the instruc- 
tions from the keyboard 2 (805). The reduced im- 
age as it is may be displayed on the display unit 3. 
or an enlarged image of the reduced image may 
be displayed so as to match the size of the display 
unit 3. 

In the example of the editing processing shown 
in Fig. 6. a rectangular area A defined by a diag- 
onal interconnecting two points (0.1. 0.1) and (0.9 
and 0.5) on the original image (1) and another 
rectangular area 8 defined by a diagonal intercon- 
necting two points (0.2. 0.6) and (0.9. 0.9) on the 
original image (2) are cut out and synthesized to an 
image (3) such that the upper left corner of the 
rectangular area A cut out from the original image 
(1) is set at a point (0.2. 0.2) and the upper left 
corner of the image B cut out from the original 
image (2) is set at a point (0.3. 0.7). The original 
images (1) and (2) correspond to the reduced im- 
ages stored in the frame memories 6 and 7. and 
the image (3) corresponds to an image subjected 
to cut-out and synthesis. A point (x. y) represents 
the coordinate values of the image. The coordinate 
information, image cut-out instruction, and image 
synthesis instruction are entered by an operator 



from the keyboard 2. 

The editing operations carried out by the oper- 
ator, including the area designating coordinate val- 
ues, alignment position coordinate values, are 
5 stored in the history memory 1 1 (806). The history 
memory 1 1 is written, as shown in Fig. 7. with an 
object image ID, an editing code representative of 
cutting out in a rectangular shape, the coordinate 
values representative of the cut-out starting point, 

jo the size of the rectangular area, and the coordinate 
values representative of the synthesis alignment 
position. The written values are not related with the 
size of an image, but are normalized vectors both 
in the vertical and horizontal directions using as an 

is origin the upper left corner of an image. 

After completion of the editing processing by 
an operator using the reduced images, encoded 
data for use in reproducing the original image data 
to be edited are read from the- data base 5 under 

20 control of CPU 1. decoded by the decoder 10, and 
stored in the frame memories 6 and 7 (807). In 
accordance with the editing procedure data stored 
in the history memory 11. the image data having 
the size of original images stored in the frame 

25 memories 6 and 7 are edited to produce an edited 
image which is developed on the frame memory 8 
(808). After obtaining the edited image of the origi- 
nal size, the edited image data are hierarchically 
encoded by the encoder 9 and sequentially stored 

30 in the data base 5 in the order starting from the 
lower hierarchic image data (809). 

In the editing stage manually performed by an 
operator, reduced images having less data quantity 
are used thereby allowing high speed editing. The 

35 editing procedure data are written by relative val- 
ues so that similar operations to those performed 
by the operator can be carried out in real time for 
the images of the original size without the aid of 
the operator. 

40 As described so far, high speed editing pro- 

cessing can be attained by using lower resolution 
hierarchic image data stored in the data base. Also 
by using the lower resolution hierarchic image data, 
high speed image search can be attained. 

45 In the above description, as an example of 

editing images, desired portions of two original 
images are cut out and synthesized. Editing image 
is not limited to the above example only, but var- 
ious editing processings are possible such as a 

so rotation processing for the whole or part of an 
image, a magnification/reduction processing of an 
image, a synthesis processing for an image with 
characters, symbols or the like. Also in such editing 
processings, the similar effects such as high speed 

55 processing can be obtained by using image data 
decoded from the lower resolution encoded data of 
the first stage among the hierarchically encoded 
image data, upon an editing instruction from an 
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operator. 

The present invention has been described by 
using the preferred embodiment. The invention is 
not limited thereto, but various changes and modi- 
fications are possible without departing from the 
scope of the appended claims. 



Claims 

1. An image editing method comprising: 

a first step of decoding low resolution image data 

among hierarchically encoded image data; 

a second step of performing editing processing of 

said low resolution image data decoded at said first 

step: 

a third step of storing editing data representative of 
the editing processing carried out at said second 
step; 

a fourth step of decoding said hierarchically en- 
coded image data to obtain original image data; 
and 

a fifth step of editing said original image data 
decoded at said fourth step in accordance with said 
editing data stored at said third step. 

2. An image editing method according to Claim 
1, wherein said second step carries out editing 
processing in accordance with an editing instruc- 
tion from an operator. 

3. An image editing method according to Claim 
1, wherein said second step displays low resolution 
image data. 

4. An image editing method according to Claim 
1, further comprising a sixth step of encoding im- 
age data edited at said fifth step. 

5. An image editing method according to Claim 
4. wherein said sixth step hierarchically encodes 
image data. 

6. An image editing method according to Claim 
1. wherein said firth step synthesizes a plurality of 
images. 

7. An image editing apparatus, comprising: 
storage means for storing hierarchically encoded 
image data; 

decoder means for decoding said encoded image 
data read out from said storage means for each 
hierarchic stage; 

processing means for performing editing process- 
ing of said image data decoded by said decoder 
means; and 

memory means data for storing editing data repre- 
sentative of said editing processing performed by 
said processing means, for said low resolution im- 
age data decoded by said decoder means; 
wherein said processing means performs editing 
processing of original image data decoded by said 
decoding means, in accordance with said editing 
data stored in said memory means. 
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8. An image editing, apparatus according to 
Claim 7, wherein said decoding means decodes 
said hierarchically encoded image data in the order 
starting from low resolution image data. 

9. An image editing apparatus according to 
Claim 7, further comprising means for designating 
desired editing processing. 

10. An image editing apparatus according to 
Claim 7. further comprising means for displaying 
decoded image data. 

11. An image editing apparatus according to 
Claim 7, further comprising means for encoding 
edited image data. 

12. An image editing apparatus according to 
Claim 1 1 , wherein said encoding means hierarchi- 
cally encodes image data. 

13. An image searching and/or editing appara- 
tus or method in which images are stored at a first 
resolution, and searching and/or editing, operations 
are carried out on one or more said images using a 
reduced amount of data representing the image at 
a second, lower, resolution. 
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